SpCO: let's not throw the baby out with the bath water.

To the editor: I read the interesting study by Weaver et al1 and the accompanying editorial by Wilcox and Richards2 on noninvasive carbon monoxide (CO) detection in the February 2013 issue of RESPIRATORY CARE. I agree wholeheartedly with those authors that CO poisoning is an important public health concern, confounded by nonspecific symptoms that challenge diagnosticians. My experience with noninvasive measurement of carboxyhemoglobin by pulse oximetry (SpCO) with the RAD-57 (Masimo, Irvine, California), since FDA approval in 2006, both in hospital settings and in fire and emergency medical services, has been accompanied by continual improvements in both the sensitivity and specificity of the technology. As a scientist and author of protocols synthesized from available clinical evidence to guide use of SpCO by prehospital providers and firefighters,3 I would like to offer some observations on the study by Weaver and colleagues. The purpose of the study was to provide information about the false positive rate of the RAD-57 pulse CO-oximeter.1 The manufacturer’s accuracy specification is 3% at one standard deviation, meaning that 68% of measurements will fall within one standard deviation ( 3%), while, according to the empirical rule for normally distributed data, 33% would fall outside one standard deviation in either direction ( up to 6%). Indeed, Weaver et al found that the RAD-57 functioned within the manufacturer’s published specifications. Yet the restrictive definition of a false positive chosen by Weaver and colleagues (SpCO at least 3% greater than carboxyhemoglobin [COHb] or SpCO 6% with a COHb 6% in a non-smoker) did not reflect the same accuracy specification. In fact, this definition was tighter than that in an early study by Touger et al,4 who reported a 48% device sensitivity in 120 patients, and a recent study of 1,578 patients by Roth et al,5 that yielded a 94% sensitivity. As Weaver suggests, the reference COoximeters also have an accuracy specification that most certainly may have influenced the comparisons between the RAD-57’s SpCO readings and the laboratory COHb values. Not cited, but a potential explanation for the findings of Weaver et al is the work of Mahoney and colleagues, who compared CO-oximetry to gas chromatography, and found that the CO-oximeters typically under-reported COHb at values above 2.5%, and over-reported COHb at values below 2.5%.6 Lastly, Weaver et al reported on 3 occult CO poisoning cases in non-smokers with measured SpCO values of 0% but COHb values of 10%. While those are not false positives, that discrepancy is certainly disconcerting and suggestive of false negatives, despite the correct assertion by Weaver et al that their study lacked the power to determine a false negative rate. I believe this highlights a key issue, discussed by Weaver et al, involving technician technique. The RAD-57 operator’s manual7 highlights several important characteristics of SpCO technology that can cause erroneous readings: selection of correct sensor size, sensor placement, and ambient light. As described in the operator’s manual, I have observed that misplacement of the sensor, or use of a regular sensor on a very slender digit, appears to allow some of the multiple wavelengths of light to completely bypass the digit, resulting in a zero SpCO reading, while others pass through the digit, yielding accurate heart rate and oxygen saturation values. While I have found that firefighters and emergency medical services providers who are frequent users of SpCO are well acquainted with both sensor placement and ambient light issues, it has not been my experience that our colleagues in the clinical community share that understanding of the operating characteristics of SpCO. Since the introduction of the RAD-57 in 2006 there have been multiple improvements in the sensor design. It is my understanding that Masimo has included finger misalignment recognition in the most recent sensor version. I fondly remember the first portable pulse oximeters that appeared in hospital wards and ambulances in the early 1980s. These were very temperamental devices, subject to interference from motion, low perfusion, ambient light, electrical current fluctuations, and calibration drift. Their sensitivity and specificity were initially terrible,8 but reached 3% by the 1990s. There were no calls suggesting that pulse oximetry had insufficient evidence for broad clinical use, as WilcoxandRichardssuggestedaboutSpCO. Rather, clinicians embraced pulse oximetry, with its inherent limitations, as a valuable tool. Certainly, no modern-day clinician would base their assessment of pulse oximetry on its first-generation technology. Likewise, I would encourage readers to recognize that SpCO was born in 2006 and offers a valuable and continually improving screening tool for CO poisoning.9 The variability of the results reported in the literature reflects the evolution of the technology and in clinician understanding of how to use it. No screening device should be used in isolation when making patient care decisions. Clinical assessment and confirmation of suspicions with appropriate laboratory testing is imperative, as Weaver et al aptly point out. Despite years of serum potassium measurement in laboratories around the world, blood collection (phlebotomy) and laboratory error remain the leading causes of erroneously reported hyperkalemia.10 There can be no substitute for clinician judgment and insight into the proper operation of medical equipment. To believe that any instrument used by humans will completely correct for operator error is wishful thinking, at best. The RAD-57, like any medical device, can suffer from operator error. Rather than condemning a new technology, I would suggest we strive to educate users on its proper operation and limitations, work with manufacturers to improve accuracy, and be certain not to overly rely on technology in lieu of clinical assessment and judgment.